How to use this model on Windows 11?
#1
by
alyxz
- opened
Since Windows has a limitation on the size of executables, how can I use this model? Should I one of the following?
- Use
llamafile.exe
executable to run this model. But it seems the cli does not support running a llamafile. - Get gguf from this model and run with
llamafile.exe
. But how to do this?